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ABSTRACT 

Coleman, Hoffer and Kilgore*s claims regarding the 
effects of, Catholic school^ on cogni;tive achievement have evoked much 
controversy. Critics have argued that the crt>ss-sectional testing 
data Coleman et al. used could not distinguish differential sector 
effectiveness frcftn selection effects, i.e., that Catholic schools 
'enroll students of superior academic competency. The First Follow-Up 
(1982) of the High School and Beyond Base Year Sophomore Cohort 
al'lows.a stronger -^design for studying this issue. Using sophomore, 
test performance to control for input-level differences in competency 
.while predicting senior year test perfoirmance in several cognitive 
domains, the common school** effect found by Coleman and his ^ 
colleagues disappears.^^The omission of, such input controls lea^s to a 
substantial upward i>ias in the estimate. of Catholic Sector effects on 
achievement. The best estimate of the Catholic sector effect'ori 
cogniti;7e growth from the sophomore to senior year, using aggregate 
sophomore-to-senior year change in performance as a yardstick, ' is 
about two-thirds of a year*s growth. DijEferences of this magnitude 
are judged to be ^substantively trivial Ibecause they correspond to 
less than .1 standard deviations in test performance. 'Sector 
differences in test performance are too small to warrant the 
attention they have received; (Author/BS) 
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Introductory Statement • 

The C^ter for Social Colonization of Schools (CSOS) has two primary 
objectives: to develop a scientific knowledge of ^how schools affect their 
students, and* 'to use thls!^nowledge to develop better school practices and 
organization'. ' , \ 

V The Center works through three research progi;ams to achieve its 
objectives: 

liie School Organization Program investigates how school and classroom 
organization affects student learning and other immediate outcomes of 
schooling.; Current studies ^ocus on parental involvement, microcomputets 
in schools, use of time in schools, cooperative leamingt* and other organiza- 
tional strategies that alter the task ,^ reward, authority and peer group 
structures in Schools and classroom^. 

Tlie Education and Work Program examines the relationl^ip between " 
schooling and students* later-life occupational and educational successes. » 
Current projects include studies of the competencies required in the work- 
. place, the sources of training and experience that lead to employment, college 
'students' major field choices, and emp^Loyment of urban minority youth. ' 
The Schools and Delinquency Program s-tudies the problems of crime, 
violence, vandalisia, and disorder in schools and the role that schools p^Lay 
in delinquency. Ongoing projects address the development of & theory of 
delinquent behavior, school effects on delinquency, and the evaluation of 
delinquency prevention programs in and out of schools. 

CSOS also supports a Fellowships in Education Research program that 
provides opportunities for talented researchers to conduct and publish 
'significanr research in ^conjunction with the three research programs. 

This repdrt, prepared .by the School Organization Program, uses longi- 
tudinal data trf farther examine the controversy about public-private school 
differences in effects., on student test performance. , • ^ 
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ABSTRACT 

- • , - ■■ , ■ 

Coleman, Hoffer and Kil^ore*s claims regarding tjie effects of Catholic schools 

on cognitive achievement have evoked nmch >jjontroversy. Critics have argued that the 
• ' , , . * 

cross-sectional testing data Colemati et.sal^us^d could not distinguish differential 

sector effectiveness from selection effects - i.e., that Catholic schools enroll 

# * » ' ■ 

students of superior academic competency. The First Follow-Up (1982) of the HigS . 

School and Beyond Base Year Sophomore Cohort allows a stronger design jf or studying 

this issue. We use sophomore test periformance to control for input-level differences 

in competency while predicting selfior year test performance in several cognitive 

domains, the omission of such input controU j^ads to a substantial upward bias in 

the estimate of Catholic sector effects on achievement. We also show that the 

so-called "common sofiooP effect found by Coleman and his colbaiagiies disappears when 

appropriate input-level test controls are applied. ^ * 

- . . . . * . * c 

^ Our best estimate of the Catholic sector effegt on cognitive growth from the 

^ • ■ ft . ^ 

sophomore to senior year, using aggregate sophomore-to-senior year change in 
performance as a yardstick, is about two-thirds of a year's growth; We judge 
differences of this magnitude to be substantively trivial because they correspond to 
less than .1 standard deviations in test performance. We conclude that sector 
differences in test performance are too small to .warrant the attention they have 
received. 



Are private sector high schools more effiatetive thani^ublic sector sdfools? As 
^ is wetl- known. Coleman. Hoffer and Kilgore claimed they were in their 1981 analysis <rf 
the issue J11981a). and in so doing set off a vigorous and heated debate that has yet 
to be put to rest. ' Despite numerous analyses, re-analyses, critical exchanges and 
strongly held convictions, we are little' closer to reaching agreement on the matter 
fthan when i:he issue first was joined. How can it be that so much concerted effort has 
shed so - little light? ^ 

The problem, we believe, is that n6 one-neither Coleman and his colleagues, nor 
their many critics-has had access to the kind of data eded for 'a proper 
consideratioa of the question. Coleman, Hoffer. and Kilgore cTnnpared'the effectiveness 
of public and privatet schools with cross-sectional data from th^ High School and 
^eyond (HSB) project. The, data set included scored for high school sophomores and 
seniors on a battery of tests developed for the project by the Educational Test>>^ 
Service (Heyns and' Hilton, 1982). Coleman, Hoffer and Kilgore judged differences in 
educ£itional effectiveness by comparing the test scores of public school students with 
. those obtained by private students after adjusting for social backgrc^d - , ^ 

charactcHstics. Since measures of test performance before high school were, not 
available in the HSB data set, the researphers w^re not able td adjust as well for 
differences in student, competenc^^ levels tl^at might have predated high school. 

Because of this design limitation, the fact that private sector students tend to 
scpre soiAewhat better than their public school counterparts on the HSB tests is 
equivocal as evidence of differential effdctivene^ss. Does this pattern occur be'ce^use 

private' schools are better at promoting cognitive development, as Coleman, Hoffer and 

• ^ p • 

Kilgore conclude, or simply because ^uch schools enroll better students in the first 
place? Since neither their data, their design; nor their analysis precludes the 
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latter possibilityp many have deemed Coleman, Hoffef^ and Ktfgore's^evidence suspect 
and their conclusions 'unwarranted. From the critics^ point of view, the effectiveness 
hypothesis has yet to be piit to a proper test, 

' And so the debate is joined. In their defense, Colein^i^ Hoffer, and Kilgore . 
point to their many efforts to work around thei^electipn' problem: their use of 
extensive socioeconomic controls as proxied for test performance; their attempt to » 
study patterns of cognitive growth through something akin to a synthetic cohort 
analysis; and their. experimentation with econometric methods for taking account of 
selection biases. The critics, in turn, have Questioned the adequacy of these 
efforts. They also have proposed additional test s^ore proxie; and/or bases of 

<;omparison (e.g.,. controlling for track membership) that they think ^ would improve upon ^ 

' * • . ■ ' 

those used by CQleman, Hbffer and Kilgore^ Indeed, tl^ere now are available several 

analyses which employ such controls,' and their use does tend to attenuate sector 

differences (Noell, 1982; Willms, 1982; Alexander and Pallas, 1983; Morgan, 1983), 

' Coleman, Hoffer and' Kilgore, in tum.^have argued that high school track is not 

a proper proxy for student competency differences. They likewise have rejected othsr ' 

published attempts to deal -^alytically with the selection issue when using 

cross-sectiohal data, such as Page and Keith's (1981) attempt to distinguish "ability" 

components in the^ HS3 test battery fpom "achievement" components.^ With but few 

r 

concessions to their protcigonists, Coleman, Hoffer and Kilgore have held to their 
original claims. . ' • 

/ This is where the debate stands at present. Neither side has produced the 
proverbial "coking gun", and neither seems much impressed with the arguments advanced 
by the opposition. The reason for this stalemate, we believe, is that all the 
contending part;^es have had.to argu» around, and work within, the constraints of 
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cross-sectional data. Fortunately, new data no^w are available that should move tkfi 

debate off stage center. . *^ . , » 

The HSB design madeprovision for /the retesting of its original (i.e., 1980) 

sophomore sample two years later. This phase of the HSB field work now is. complete «md 

the^data recently have entered into the public domain. They hold great promise for 

clarifying the question that was first posed, but never satisfactorily addressed* I'v 

Coleman, Hoffer and Kilgore. We* now can examine how individual patterns of test • 

performance change between the sophomore and senior years, and whether such change is 

more pronounced ^mong youngsteris attending private schools than among those attending 

public ones. These data, then, allow for a direct test of the hypothesis that private 

schools are more effective than public in promoting cognitive development, with 

appropriate controls for input level test performance. <k 

:>Therpresent analysis parallels that used in our earlier examination of the 
.. • ■ . . ' * 

cross-sectional HSB (and NLS Class* of '72) data (Alexander and Pallas, 1983), except , 

that sophomore test scores are used to adjust for **input lever competency differences 

f and sei\ipr test scores are used as outcomes. Although we continue to think our 

earlier effort a worthwhile counterpoint tcT Coleman,. Hof for and Kilgore's excessive 

. ■ * I ^^'^ * 

claims, we acknowledged thej^that it labored under the same design . restrictions that 

hampered their original analysis.^ Our intentions in that piece were two'fold; to 

raise probing questions and to evaluate the tenability of theif cross'sectional 

conclusions. The HSB panel data, though, should provide more' secure answers to the 

original question of diff ere itlal sector effectiveness. ' 

. / The^ conceptualization which guides our ^alysis^s depicted in Figure 1. It is 

very similar to that proposed by Kilgore (1983) in D^sponse to our earlier ^ criticism ; 

of her work with Coleman and Hoffer; We indicated then that 'we had no particular 

9 



problems with this framework, but felt* strongly that neither she nor we were able to 
do justice to it With the HSB follow-up data, though, its implications can be 
evaluated properly. « ^ • 

/ - Figure 1 About Here 
As in ouT earlier analysis, sector effects are estimated net of differences 
associated with various student characteristics (i.e., SES background, race and 
gendec) and measures which tap regional differences. Here, though, we add sophomore 
test performance as another "input** control. Qne difference between this « 
specification and our previous one is that now high school track membership 
(cdhtrasting academic enrollment with general) intervenes between sector and the 

; . ' ■ ^ / 

several domains of senior year test performance. 3efore we used high school track as 
a proxy for unmeasured cognitive* differences, but this no longer is necessary since 
direct controls are available. Rather, we now entertain the possibility that track 
membership is important as an aspect of school organization. Coleman and his 
colleagues argued this in response to our analysis, as well as to others which used , 
the track variable in this way <e.g., Mdrgan, 1983). They contended that channeling a 
large percenjtage of students into the. college track was one of the ways private sector 
schools realized their superior performance. ' - 

The proper interpretation of the curriculum variable in these analyses is a 
matter of considerable importance, for secto^ differences within tracks generally are 
much smaller than those observed overall (Peng and Fetters, 1981; Wilbns, 1982; 

• • r 

Alexander and Pallas, 1983). If one thinks of the track variable as a proxy fof 
unmeasured student diffierences, then the available 'evidence offers little indicatioip 
of differential sector effectiveness. If, on the other hand, tracking is important ss 
a mechanism of school policy, then the differential effectiveness hypothesis receives 



stronger support (although still in the absence of proper controls for student 

competency differences)* Having available -a baseline, assessment of test perf ormance, 

we now can grant Coleman, Hoffer and Kilgore their preference on the track membership 

issue. This framework, then, will isolate sector influences upon patterns of ' 

cognitive growth and the mediation of sector effects through patterns of curriculum 

placement. < ' * 

* ' '' 

As in otir earliet* study, we again limit our comparison to public and Catholic 

schools. This is4>ecause the HSB project included too few don-Catholic private 

schools to allow secure 'generalizations, a point > conceded by Colemanf, Hoffer and 

Kilgore (1981b; 1982b). We also have excluded vocational 'track students, owing to 

^heir sparse numbers in Catholic schools. Although this is not reflected in the " 

diagram, all analyses are performed separately for public and Catholic schools so that. 

interactions yv^olving the sector distinctioiv will not be obscured. Coleman, Hoffer 

and Kilgore have placed great importance on allovring for such interactions and have 

been espepially critical of studies .that .fail to make provision for them /(Coleman et 

al.. 1982b; Coleman and Hoffer, 1983). Since one of our purposes is to evaluate the 

resilience of Coleman, Hoffer and Kilgore's cbnclusionjt, we thought it best to defer 

to their^ preference here as well, although we ourselves don't believe the matter ,to be 

as important in practice as they take it to be. 

•I ^ . ' 

There is, though, another reason for proceeding in this way. Doing so allows us 

to reevaluate Coleman, Hoffer and Kilgore^s claim that private sector schools better 

approximate the ** common school** ideal than do those in the public sector. The basis 

- ■ » . ^ 

for this conclusion is that differences in test rerformance* associated with racial and 

ethnic group membership .and with 'socioeconomic origins are less pronounced in the 

private sector. We, along with others (Bryk,''1981; Goldberger and Cain, 1982; Cain ^ 
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and Goldberger, 1983), \iay/ expressed the concern that this, pattern too might simply 
reflect selection differences (i.e., that private schools have a disproportionate 
enrollment of highly capable minority and disadvantageij youngsters). IJfence, we will 
be interested, to see how the inclusion of a suitable control for test ecore 
differences affects this detail of the results, as well as the taore general matter of 
overall sector effects. 

In tfte next section we review sample selection considerations, measurement 
procedures, and techniques of analysis. Following this, we turn to the resulU 

themselves. _ ^ * ' 

» • 

^ METHODS 

This analysis uses data from the High School and Beyond 1980 Sophomore Cohort* 
Base 'Year (1980) and First FoUow-Up (1982) Purveys. Our strategy shall be to use 

1980 Sophomord test scores/as inputs controls in equations predicting 1982 senior year 

'I ■ ■ 

test pdrformlmce. A particularly important consideration in attempting to model 

sophomore to senior growth is how dropouts are hanaldd. If, for instance, the dropout 

rate is higher in public schools, and^fbpping out is associated with j>oor' test 

performance, then the pubfic^Catholic sector difference in test performance likely 

would be Attenuated. Coleman, Hoffer'and Kilgore (1982a; 1982c) attempted to estimate 

sophomore-to-senior year learning rates using a synthetic cohort-like approach with 

^^adjustnjents foij both student background differences and dropout differences, but those 

efforts have Seen received quite critically (Goldberger and Cain,- 1982). 

Fortunately, this problem is averted in the HSB panel, because dropouts were 

inctuded in the firk follow-up survey along with several other classes of students. 



(e.g., transfers). The Base Year sample of High School and Beyond consisted of 
'roughly 30,000 sophomores in more than 1,000 high schools. Students still enrolled in 
their Base Year schoots at the time of the First PoUow-Up were sampled with a 
probability of 1.0. Students who were no longer attending their Base Year schqpls at 
the ^e of the first Follow*Up {i.e., dropouts, early graduates and transfers) were 
sampled at lower rates. The sample allocation consisted of 25,150 still-in*school 
seniors, 2»601 dropouts, 1,290 transfers to non*HSB schoolsr and 696 early ^high school 
graduates. Properly weighted, this sample projects -to the population of roughly 
3,800,000 high school sophomores of 1980. The HSB weighting factor for cases having 
both BasQs-Year and Follow-Up testing data is used- throughout our analyses. Further 
details on the sample and data collection may be found in Jones et al. (1983). 

Questionnaire and testing data were collected as part of the first follow-up. 
The response rate for completed tests ranged from 78% for the dropout sample to 90% 
for the still-in-school sample.- These figures compare favorably to the response rates 
of 77% for the Base Year sophomores and ^2%^for.4l^e^J3ase Year seniors. In light of 
these figures, it appears that the HSB re-testing program was^bijS^ily successful, and 
this simplifies considerably our analysis plan. 

High School and Beyond administered the same battery^ ^of tests to the 1980 
Sophomore Cohort in both the 1980 Bas^ Year and the 1982 First PoUow-Up phases of 
data collection. Tha areas covered in the tests are Vocabulary, Reading, Mathematics, 
Science, Writing and Civics Education. Mathematics is constructed as the sum of two 
mathematics subjects. Additionally, a composite score was constructed as the sum of , 
the first three (i.e.. Vocabulary, Reading and Mathematics). The Science, Writing and 
Civics tests are .designed to measure curriculum-specific achievement. For all tests, 
we employ the formula scoring, which includes a correction for guessing. 



Reliabilities for the sophomore tests, as reported by Heyns and Hilton (1982), range 
from .53 for Civics, to .85 for the Mathematics I test. From these figures, the 
estimated reliability for the Composite is .92. We assume the reliabilities to be 
constant across the two administrations, and hence apply the sophomore estimates to 
the senior tests as well. Further information on the HSB tests cm, be found in Heyns 
and HiltQj (1982). . . 

- Table 1 About Here - 
The other variables used in the analysis are_taken either from the sophomore 
questionnaire or, in the case of our school location measures, from the %tratif3^g 
information used in drawing the HSB sample of schools. As student background 
controls, we include measures of family SES, of the students' race/ethnicity and of 
the students' sex. The sources and coding of these data are summarized in Table 1. 

RESULTS 

To determine whether Catholic schools produce superior test performance, we 
performed several wlthin-sector regression analyses. These differed frqm x>ne another 
in the mix of control variables they included. The weighted N varies across dependent 
variables and ranges from 2.338.917 to 2,501.801 in the public sector equations, and 
from 209,487 to 211,814 for the Catholic sector equations. 

By performing separate analyses for public and Catholic schools, the effects of 
our coritrol variables are allowed to differ in the .two contexts. Coleman, Hoffer and 
Kilgore liave concluded that such interactions are quite important (they are the basis 
of their "common schoor interpretation), and they have been especially critical of 
analyses which failed to make provision for them (e.g., Noell, 1982). 
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A "standard" f^-. of controls is included ih all of ou^ estimations^ This^ 

includes selected student background characteristics (i.e.. /^ace. gender, and family 

• ■■'■'■/' ' ■ 

socioeconomic level) and ^^ariables that capture locational differences in the 

distribution of schools (i.e.. region of the country).^ These are thtf same, "input" 

controls used in our^ earlier analysis of the senior year cross-sectional data * ' 

(Alexander and Pallas. ,1983). and they are reasonably reflective of the control ' 

strategies used in this literature generally.^,. Adopting this same approach as the 

baseline for the present inquiry wiU allow us to judge its adequacy as an analysis 

, ' ' f ■ ' 

strategy. This is potentially quite important, for virtually all studies to date have 

had to rely on this general sort of approach. ' 

For our major substantive analysis, which we report first, sophomore' test scores 
are added to this sjet of background Gontrols.- Since the HSB project administered 
parallel test batteries in the sophomore and senior years, we are in the fortunate 
position of being able to adjust for prior levels of performance in the same cognitive 

■ ' - • * .' 

domain before judging- sector differences. Despite our many othrf differences, the 

■>■ . ■ - 

contending parties to this debate at least have agreed that this is the. preferred way 

to study school effects on cogWive outcomes (Alexafiy^er ;^id Pallas, .1982; Coleman, 
1982). - 

Although this probably is the strongest non-experimental design for - 
investigating patterns of cognitive development between the sophomore and senior years 
of high school, one potential -problem is that is neglect sector differences which 
express themselves in patterns of performance tRrough the Spring of the sophomore 
year. More will be said of this later, but for now we wish simply to emphasize that 
ouF analysis looks forward from the sophomore year. Of course, it would be a peculiar^ 
sort of effective school which exhausted its impact in the first year or two, 



especially since these years presumably' are devoted primarily to lower level/ . » 
materials. Because of such considerations* we aren't especially troubled by this 
design 'limitation. Neither, we gather, are ^Coleman and his colleagues, since they 
went to great I^iigths to approximate such a dhange analysis when neither design nor 
data were especially well suited to the task. • 

In the analyses wh\£h follow, we have corrected all r^ression results for the 
attenuation induced by random errors of measurement in the cognitive performance 
measures. Corrections are employed for both the sophomore year input test controls 
and the senior year ^criterion measures. Our analyses implicitly assume that all other 
measures in the analyses are perfectly reliable. Computationally, the attei^uation 
correction involves dividing the elements of each vrithin-sectoK zero-order correlation 
matrix by the square root of the product of the estimated reliabilities of the 
variables referenced by the element (Nunnal^, 1977). 

Table 2 presents our best estimates of how school sector conditions cognitive 
development between the ^ophomofe^and senior yearar~Because these sector differences 
are derived with the sophomore year counterparts of the outcome measures controlled, 
the results indicate whether cognitive growth (in the sense of .improved levels of 
performance) actually is more pronounced among private sector students. Being able to 
take account of **ihput-lever performance differences in this way should allay most 
concerns regarding selection^ biases. 

However, there still is one way in which selection differences could be 
confounded with the sector distinction, and this at least deserves mention. If 
youngsters in the two sectors were developing cognitively ' at different rates at the 
time of our initial observations U.e;, toward the end of the sophomore year) and this 
difference persisted throughout the time frame under consideration, then \hese \ 



different devejopmental patterns would show up in our analysis as differential sector 
growth even though they might h^vejittle (or nothing) to do with organizational, 

influence. In fact, ^because of this potential problem, Coleman, . Hoffer and Kilgore, 

^ * « ■ 

in an addendum to their book (1982c: 209), draw th^ following conclusion regarding the' 

promise of such panel assessments: ''Thus, 'selection bias' haunts longitudinal 

studies almost as much as it does cross-sectional studies." ^ 

This statement* probably is true as far as it goes,'«but it doesn't go very far. 
. * 

If there is reason to cuspect differential learning rates across sectors, then it 
likely will be the higher- peHfcnrming students who progress at the faster pace (Werts 
and Hilton, 1977). Since Coleman, Hoffer and Kilgore already have concluded that it 
is^ private school youngsters who perform better, then such bias probably would favor 
the private sector. Okieck (1981), in fact, makes this point In his cpmmentary on 
Coleman, Hoffer and Kilgore's research. 

This, then, is yet another reason to be skeptical regarding Coleroan> Hoffer and 
Kilgore's original results, and they are quite correct that it could complicate panel 
assessments as well. But the concern with their analysis is that it might overstate 
the Catholic school advantage. Being able to control expliciUy for input level test 
performance surely must be judged an improvement over estimations which do not employ 
such controls. The fact that results from such an approach might still be biased in 
favor of the private sector is something to be mindful of in making sense of the 
results, not a reason to forego an improved evaluation. 

We grant that longitudinal analysis is no panacea* but at least in this^ instance ^ 
we can be reasonably confident as to the likely consequences of those complications we 
cannot bring under control. These suggest an important caution in interpreting any 
private sector advantage, but they give no reason to suspect our analysis vriill 
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understato that advantafes. This would be our major concern, since in re-evaluating > 
Coleman. Hoofer and Kilgore's conclusipns we want to be especially pareful not to err 

in the other direction. . 

I' . ■ . ■ • 

In, Table 2. we include three alternative representations of the estimated sector 

differences. They are entirely equivalent, but differ in their frame of reference. 

. To generate the figures in TaWe 2. the paired PubUc and Catholic equations for each 

outcome were evaluated by means, of a regression standardization (Althauser and Wigler. 

1972: lams hnd Thornton. 1976). Actually, two such standardizations were performed. 

The first calculated predicted outcome levels by*applying public school predictor 

m<.ans to the separate sector parameter estimates, these are the values reported in 

■'•.«■• s • ' 

Table 2. This approach derives the levels -of test performance that would be expected 

it schools in .the two "sectors enrolled students similar to those 'presently attending , 
public schools and if both sets of- schoo^ were distributed regionally like the , 
present mix of public .schools. • , ^ 

A second set of calculations also v^n done which parallels the first, but uses 
Catholic school means throughout. This app^ch. then, asks how large the differences 
would be if 'schools in the two sectors enrolled sti^denU like the ones that now attend 
Catb<ilic schools (and if they were distributed regionally as Catholic schools). These 

. • results (along with those highUghted in Table 2) will be presented in Table 3. in 
which several issues of secondary ithportance are considered. For now. , though.- we . 

' focus on the differences that are observed at the public school means, because these 
' correpoi^ most , closely to the sort of policy change contemplated by Coleman, goffer 
and Kilgore -- that is. broadening access to the private sector for the kinds of 

. students who presently attend public schools. Although the pattern of results is not 
very different under the two assessments, sector differences consistently are smaller 
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v^hen using the CatKolic school means. Coleman, Hoffer and Kilgore observed a similar/ 
pattern. 

The first column in Table 2 presents the results of these computations at the 
public school means as simple formula score differences. Although it is difficult to 
judge the significance of these figures without a frame of reference that provides a 
tangible anchor, we suppose it is of some interest -•that all the differences, except 
that for the composite, are well below a single item. More informative, though, are 
the representations of thiese differences in the second and third columns. 

- Table 2 About Here - 
The seconi set of entries express^es these dj^erences as fractions of a year's 
growth. This same standard was used by Coleman, Hoff^r and Kilgore^ in much of their 
work, and is the basis for their summary generalization that Catholic schools perform 
about a year above public schools. In 'thi&ir analysis, the estimate of a gear's 
growth** was c&mputed as half the background^ adjusted difference in average performanc 
levels between the public school sophomore and senior samples. Our figures, on the 
other hand, reflect patterns of individual change over the two year interval covefed 

"^by our panel. They arc simply half the difference l>etween 1980 and 1982 test mean^. 

' The entries in the second column express the formula score sector difference as a 
fraction of this estimate of a year's averiu^e grovrth. For only one of the seven 
evaluations does the difference reach Coleman, Hoffer.and Kilgore's standard of a 
year, this being on the reading test. .For both of the other two^teits which tap more 
generic competencies, the sector difference is well below this leyel* being only about ^ 
two-thirds of a year for vocabulary and merely a third of a year for mathematics. 

The bst three tests are subject specific asses.sments. These cover science, 
writing and civics. Several critics {Heyns and Hilton, 1982: Goldberger and Cain, 
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1982) have argued that such curriculum-linked test's 'would be a more proper basis for 
judging school effect] venttss, since they tap knowledge that presemably is acquired 
largely in school. Although these tests were available for the HSB sophomores in the 
base^year of the project, Coleman, Hoffer and Kilgore (1982b) declined to consider 
them because companion tests were not available for the Base Year senior cohort. They 
. were re*administered during the first follow-up, however, and we are able to include 
them in the present analysis. ^ 

The results for these three subject-specific tests differ from those for the 
first four tests. The diffemice^n the writing test is largest of the three. At .64 
years, it is about as large- aS; the vocabulary /difference. The other two, though, both 
are mucK smaller, with that for Civics actually favor ing, th^ public schools. These 
figures, then, offer no reason to think that Catholic scnoois do especially well on 
curriculum-linked tests. In fact, their advantage, if anything, is smaller on these 
assessments, a pattern that is contrary to expectation if organizational efficacy is 
what really is at issue. 

While these differences generally are a good bit smaller than those reported by 
Coleman. Hoffer and Kilgore, it is difficult still to know wKether they are large or 
small in any absolute sense. Coleman, Hoffer and Kilgore present their finding^ of 
about a y^r's difference as though it were a si:^ble gap, but they don*t tell us the 
b^asis for this judgment and just a bit earlier in their book* they discuss the two year 

sophomore to senior public school difference (which i$ the basis of the year ^ 

• " • ■ 

benchmark) as though it were rather small. Is half a small differience large enough to 
be deemed important? They seem to believe so, but fail to say why. 

Setting aside the Civics results, a reasonable summary for our data probably 
would be closer to two-thirds of a year, which would correspond to about a third of a 
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small differience. Again, is this large enough to justify the conclusion of an 
important Catholic school advantage? The standard of % year's growth isn't very 
helpful here, and it is for 'this reason that we prefer the base of comparison >uilt 
into the third modp of presentation. 

The last column expresses the estimated sector dilTferences a» fractions of the 
test battery standard deviation. Although evaluating the sector difference against . 
the variability in the test itself still does not afford an absolute standard, it at 
least provides an internally consistent frame of reference. From these comparisons we 
can judge the average test acore difference across sectors against the variability in 
the trait. 

This' seems to us to be the best of *the le&s than ideal oplion^ that are 
available, and by this standard the sector differences quite clearly 'are small. Only 
two differences are even as large as a tenth of a standard deviation, itself a very 
modest threshold. These are for tln> vocabulary and writing tests. For the two other 
domains studied by Coleman, Hoffer and Kilgore - Reading and Math - the differences 
both are but six-hundredths of a standard deviation. As bifore, the figures for the 
subject specific tests are eve|i smaller. 

Incidentally;, when Coleman, Hoffer and Kilgore's corresponding cross^sectional 
results are considered in like fashion, the differences range from .144 to .189 
standard deviations for the tiophomore cohort and from .114 to 284 standard -deviations 
in the senior analysis (see Table 5, below). Clearly, then, our piinel analysis 
indicates a considerably smaller Catholic school advantage, either when judged as 
fractions of a year's growth or as fractions of the test standard deviation. This 
pattern of differences seems to substantiate the concern expressed hy many that 
Coleman. Hoffer and Kilgore's design and analysis likely overstate the performance 

V 
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deference between public sector and private sector youngsters that is attributable to 
organizational factors. Our own evaluation of the sector effects in Table 2 is that 
differences below a tehth of a standard deviation are too small to be considered of 
practical importance. - • Since judgments of substantive importance are, we believe, the 
central consideration, this pattern of results not only scales Aoym Colem€[n, Hoffer 
and Kilgore's estimates of sector impact, but it also overturns their general 
conclusion. 

As mentioned above, the results in Table 2 are our major substantive 
conclusions. However, several subsidiary issues that arose repeatedly in the 
exchanges between Coleman, Hoffer and Kilgore and their critics are considered in 
Table 3. In this table, comparisons are reported at both the public school'means and 
the^Catholic school means, and the figures from Table 2 are reported as the first row 
of results to serve as a base of comparison with the others. To simplify matters, we 
only report sector differences as fractions of the test standard deviation. This 
corresponds to the third column of results in Table 2. 

Table 3 About Herev>- 

The first issue considered in Table 3 is the adequacy ^f background measures as 
proxies for test score controls. It will be recalled that^Sbleman* Hoffer and Kilgore 
had to rely upon such surrogates. Despite the reservations voiced by many, they have 
held to the position that these served their purposes adequately. We are able to 
evaluate this by estimating sector differences using only background controls (the 
second row of results), and then comparing these against those obtained when test 
controls are added to the analysis (our substantive 'results, reported in the first ^ 
row). 



32 . 



. . • If Coleitaan. Hoffer and Kilgore are correct in their opinion that background 
conti^ls adjbst adequately fpr selection differences, tllpn the two seto of results 
should line up rather closely. Clearly though' they do '^ot. In fact, the differences 
generally are quite substantia^ with the background-adjusted estimates usually being 
from two to four times the value obtained with test controls. Bias this magnitude 
could hardly be considered negUgible. These comparisons <ilemon8trate again (e.g.. 
Alexander^ McPartland and Cook. 19^1) that background proides simply are inadequate 
when attempting to assess school organization impact on cognitive outcomes. 

r , ■ * 

\ 

The second issue considered in Table 3 is whether curriculum ^licemeut plays an 
important role in Mediating the (small) private sector advantage obtained inj^ur 
substantive analysis, ft wUl be recalled that Coleman. Hoffer q^d KUgorff argued, tii 
response to those who proposed using the curriculum variable as a proxy for unmeasured 
student differences, that sector differences in currfoulum placemetit are a result of 
school policy differfsnces, and hence that curriculum is important as an organizational 
variable. We now are in a position to evaluate how much of the sector effect actually 
is mediated through curriculum placemant. ^ 

This is accomplished by adding curriculum to the analysis and comparing the 
sector differences that are obtained when curriculum" is iiot controlled (row 1) with 
those estimated with curriculum controlled (row 3). The difference between these two 
estimations would reflect }Jie anticipated mediation. Most of the estimates, though, 
are un^fected by the addition of curriculum, v and where changes do occur tl^ey are 
extremely slight. Hence, we see lijttle indication that privatp sector ^cjiooling works 
its magic by chaitneling ^ disproportionate numbef of its students into the academic 
curriculum. Of course, the^ adjqsted sector differences themselves were so slight that 
there wasn't much for the curriculum variable to mediate .in the first place. Hence, 
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we find little support for Coleman, Hoffer and Kilgore*8 argument that sector 
differences in tracking policy are an important organizational means by which private, 
schools promote high levels of test performance. 

Theiast issue considered in Table 3 is how well the curriculum variable served " 
the interests of Colem^, Hoffer and Kilgore's critics, who argued that its usei^in the 
absence of test score controls would reduce selection biases. This can be judged by 

9 

comparing the fourth rpw of results, which adds curriculum to ^he analysis but drops 
the test control, with the first, which is the preferred approach (i.e., uses test 
controls, ^nd not curriculum), and with the second (which uses jonly- background 
controls). Here again, the pattern seems rather clear. Although the estimated sector 
differences when curriculuift* is used as a proxy for testing data are gejierally a good • 
bit larger, they at least are .9 notable improvjsment over the figures derived when 
background controls alone are used. It thus^eems ^clear that the. 
curriculum-controlled figureaHare preferable to tlie background adjusted figures, but 
we don't take much solace in having been so vindicated. What we hadn't realized when 
urging the merits of the ^curriculum prosor was l\pw far off the -mark its use still left 
us. Fortunately, with suitabfl test score controls now available, we no longer need 
rely on this patchwork framework. < 

The last issue we consider is whether achievement processes in Catholic schools 
better approximate the common school ideal than do those in public schools. Coleman 
and his colleagues dontend they do based on their finding that test scores are less 
strongly related to student background '^characteristics in the private sector. But 
since these results too were derived without proper controls for prior test 
performance, they also should be deemed provisional. 
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The detailed regression results . behind the comparisotfs in rows one dnd two of 
TaWe 3_speak to this issue. It wilUe recalled that the first of. these .estimations 
had test controls, while the se4nd did not. Hence, differencel^n^the background 
coefficients between the second and the first wUl teyeal whatever distortion might be 
due to the omitted test^ conCrol. 

"* •• Table 4 About Here -- . ' 

Table 4 presents' these background coefficienU. The first two colunlns are from 
the public ind Catholic equations when sophomore test performartce is not controUed. 
The third column is the sifnple difference between them. The last three columns are 
the corresponding figifres for the equations which include t^st scores^ To highlight 
the issue, comparisons in which the CathoUc coefficients are larger than their public 
sector counterparts have been set to zero. * «> 

It is apparent from^hSSfr figures that support for the common school hypo'thesis 
evaporates under the second specification. In eighteen of the twenty-one comparisons 

« * ■ • * 

from the first analysis the differences are in line with Coleman. Hoffer and Kilgore's 

• expectations. That is. the coefficients are smaUer in the CathoUc equations. When 

. : • ■ - " - -'i 

sophomore test scores are, controUed. the pattern changes dramatically. In the second 

■' ■ '- • ■ ■ • (J' 

•instance, seventeen of the twenty-one differences actuaUy favor, the pubUc schools 

and the remaining differences have shrunk considerably from their original values. 

We conclude, then, that th^ relationship of student background characterisUcs 

to patterns of cognitive development between the sophomore and senior years is very 

simUar m pubUc and CathoUc schools. It is not the case. then, that minority 

youngsters and students from low SES households are more successful in j>rivate schools 

when compared against equivalently competent public school students. Here too. 

Coleman, Hoffer and Kilgore are not sustained. 



DISCUSSION 

To recapitulate, our reading of the results in Tables ,2, 3, and 4 suggests two 

main conclusions. First, and most importcKitly. there is little support for the notion 

ft 

that cognitive development in Cathblic schools outpaces that in public schools between, 
the sophomore and senior years. Our second conclusion is that background 
characteHstics rebt^ to test perfonnanco in similar fashiom in the public and ' * 

Catholic sectors. We therefore find no siipAUrt for Coleman. Hoffer and Kilgore's 
"common schooP hypothesis that minority and disadvantaged youngsters are especially 
well served by privaU sector schooling.' Our remaining comments elaborate uvon the 
first of these two conclusions. 

Our analysis does indicate, a small Catholic sector advantage for most outcomes. 
It is somewhat, larger for more generic competencies than for subject -specific 
assessments, but even in the former ar^as most differences are less than a tenth of a. 

standard deviation. These differences correspond to about two-thirds of a year's 

' » ■" " """ - . _ ^ ^ 

*t * 

growth, on gjt^rage, but some differences are a good bit smaller. 

it turns out that these estimatibni^ are not all that different than those 
previously reported by Cojieman» Hoffer and Kilgore and others, but under deficient 
designs. To be sure, our specific figures are loM^r.' but not dramatically so. In 
fact* much of th^^ebate over the matter has hinged, we believe, on different 
standards of judgment, which too often are only implicit. 

Anyone who has tried to stay abreast of these ongoing exchanges knovrs h6w dense 

and detailed they can become. Much of .the argument strikes us as misplaced, such as 

< 

* 

quibbling over the correct standard error to be used in determining statistical 
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significance. With Bn implied sample size in the millions, that judgments might hinge 
on alpha levels itself makes the case that there is not much going on. Kilgore's 
recent (1984) statement that she expects the Catholic sector advantage to be positive 
and significant when properly evaluated similarly begs the issue. Substantive 
importance, rather than statistical significance, should be our concern, and here the 
debate offers little constructive guidance. 

From the outset, we havt been of the opinion that the sector differences 
observed by Coleman. Hoffer and Kilgore were too small to warrant much attention. Tl 
fact that their figures likely were overly generous due to design weaknesses simply 
reinforced that belief. Indeed, we beg^n our response (Alexander and Pallas, 1984) to 
Kilgore's critique (1983) of our earlier analysis as follows: "We agree with Kilgore 
on only one point: that the results we present are not all that dissimilar from those 
reported by her and her colleagues. What is striking is that we read their 
implications so differently." Her rebuttal (1984). in turn, is entitled "Schooling 
Effects: When is a Liitle Alot?" We apparently agree that these effects are little. 
"We differ, though, on whether they are properly deemed "alot". A bit of history is 
relevant here. 

Co>eman, Hoffer and Kilgore have used various strategies to estimate sector 
effects on cognitive achievement. They have examined cross-sectional differenced 
adjusted for student background (1982c), and "change" scores comparing the Base Year 
sophomore and senior cohorts, controlling for social background, as well as adjusted 
for dropouts (1982c). They h ave a lso examined learning rates, adjusted for background 
and also for dropouts (1982c). Additionally, they have assessed sector differences in 

• * 

specific "organizational" predictors of test perf9wim!Uifi(1982 ), and they have 
controlled^r adjusted for curriculum (19811/ 1983: 1984). TRhese diverse strategies . 
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make comparisons across analyses quite difficult, as the units in which effects are 
expressed often change along with the approach. 

We have tried to convert their mai^ results into a common metric, either a 
fraction of a year's growth or a fraction olT the criterion standard deviation. These 
comparisons are summarized in Table 5 (construction of the table is described in 
detail in Alexander, 1984). 

" Table 5 About Here 

Considered side-by-side and in comparable terms, there is a good deal of 
variability in Coleman. Hoffer and Kilgore's own evidence regarding the supposed 
Catholic advantage in vocabulary, reading and math. In their major statement (1982c: 
141). they conclude that Catholic schools surpass public schools by about one grade 
level after adjusting for socioeconomic differences. However, this difference is 
observed consistently only for the sophomore cohort cross-sectional analysis. The 
results for their "change" analyses all fall far short of the standard of a year's 
growth, and those from their third analysis, which works through the implications of 
differences in specific school resources and experiences, fluctuate in size- across 
performance domains and in pattern across cohorts. ^Moreover, in comparing across 
analyses we observe many curious inconsistencies. Hence, their original analyses are 
inconsistent in ^ the advantage they attribute to Catholic schools, with, the differences 
frequently falling below their standard of a year. 

Also, their more recent statements on the magnituc e of ^sector differences have 
mod ified downward this initial claim. In Kilgore's first response to our 
cross-sectional analysis, she reports what she believes are preferable curriculum- 
adjusted figures. These credit the private sector with ^ome of curriculum's influence 
_because-privat6^ sch<r(5r policy se^^ to channel more youngsters into the academic 
. . . • ^ 
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track. Although we are not much impressed with the basis for these calculations 
(Alexander and PaUas. 1984). they nevertheless lead Kilgore (1983: 185) to conclude 
that Catholic schools produce "at least a one grade level advantage in mathematics and 
vocabulary, and slightly less than one grade level in reading." This characterization 
seems to us a bit weaker than in the original, volume in that it explicitly exempts 
reading from the one grade level standard (although some statements in" the book 
include this qualification, it is not "carried along consistently in their summary 
statements). . . 

■ The latest recasting of their findings appears in Kilgore'^ (1984) second 
rebuttal to our SOE' article. Acknowledging the need for a better yardstick by which . 
to gauge the magnitude and meaning of sector differences, she turns to Jencks and 
Brown's (1975) estimate of learning rates between the ninth and twelfth grades based 
on Project Talent panel data. Assuming an annbal learning rate of .22 standard 
deviations, Kilgore computes a Catfiolic sector advantage of .68 grade levels in 
mathematics, .77 grade levels in reading, and 1.41 grade levels in vocabulary. Rather 
than an advantage of "at least a year" in all domains, this claim now applies only to 
performance on the vocabulary test. 

The above, we believe, summarizes what Coleman, Hoffer and Kilgore have had to 
say regarding public-Catholic differences. Our review is sketchy on technical detail, 
but it is accurate nevertheless. We also have withheld evaluative comment. Our 
intention is not to critique these various presentations, .but simply tp lay them out 
so that we can properly judge how well our results correspond to theirs. We find a 



Catholic sector advantage that averages about two-thirds of a year across several 
cognitive tests. This is quite close to ^Igore's most recent claim for two of the 
three tests that they^ considered in the^ work. 



39 



It seems, then, that after several rounds of reflec^tion (and -some re-analysis). 
Coleman. Hoffer. and Kilgore's more modest appraisal of their evidence lines up 
reasonably well at with at least some of the results from our analysis of change. 
Using the yardstick borrowed from Jencks and Brown, though. Kilgore goes on to 
conclude that, these grade level equivalency differences '^are not small.** She thus 
seems to think that casting her results in terms of grade level equivalencies provides 
a basis for deeming *'a iittie** to be '*dlot.'* We're not sure why this should be the 
case (her comment offers no explanation). . but we judge our estimate of .67 grade level 
differences to be simply "little**, and far too little to warrant Coleman. Hoffer and 
Kilgore's indictment of public sector schooling as inferior to that in the Catholic 
^ sector. We judge these small because they correspond to differences that are Jess 
than fl test score standard' deviations. Hence, the difference in test v performance 
that can be attributed to sector differences is minute relative to the variability in 
cognitive skills. Sectbr effects simply 'don*t matter much, and talking about them as^ 
though they did is both poor science and a poor basis for informing public policy. 
These were our earlier conclusipns, and further analysis seems to sustain them. 

Finally, in the introduction to the present analysis we acknowledged a lingering 
uncertainty^ Our results do noTt adjifess-the jfpssibility of sector effects on test 
scores through the tenth grade. Coleman. Hoffer and Kilgore studied sophomore 
patterns of test performance and interpreted them as reflecting differential sector 
effectiveness; their critics, ourselves included, felt they more likely were due to 
selection-di ff e r e nce sr°''^telther they nor their critics could muster conclusive 
evidence on the issue, and this remains the case still. Lacking a propel evaluation, 
we therefore must continue to rely on circumstantial indications 'and reasoned 
judgment. 
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Covider the figures reported in Table 6. These are zeroK>rder correlations 
relating backgroond characterisUcs to each other as w^U as to the test battery" 
composite. 'Results for the other tests would be quite simi^^ir^We focus first on th^ 
zeroH)rder associations between background and sophomore test performance across the 
two sectors. These a^e smaller in the Catholic sector than in the pubU6 sector. 
Coleman, Hoffer and Kilgore interpret the lower Catholic sector correlations between 
the background characteristics of SES and race/ethnicity, on the one hand, and test 
scores, on the other, as evidence for their common school hypothesis. Of course, they 
focused on how these correlations expressed themselves in a re^ssion analysis, but 
this is incidental to our point. Others suspected these differences simply reflected 
that low SES and minority youngsters who attended privAte schools were somewhat 
exceptional in the first place. The correlations in Table 6 relating background and 
test performance in the two sectors do not distinguish between these two 
interpretations. They could have been generated either by differential selection 
processes or by Mifferential sector effectiveness. 

-• Table 6 About Here •• 
Other correlations in Table 6. though, are unambiguously the result of selection 
processes. In particular. -the correlations between minority group status and SES 
level necessarily reflect selection differences.' Table 6 shows a sizable negative 
association between race and SES in the public sector, consistent with our knowledge 
n hni i t the r e l a tive ra nking of^^minoritles-in^ American society generaiyrnST^ 
CathoUc sector, however, there is virtually no correlation between race and SES. 
This is a peculiar pattern^ to be sure. 

While it at least is conceivable that -private school organization could operate 
to attenuate the link between background and test performance, it is highly dubious 
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tlMt any iort of organizational int«rv«ntion could alter the background connection 
between BiiDority itatus and' socioeconomic disadvantage. It is striking, therefore, 
that 9BS and minority status should he so loosely coupled among Catholic school youth. 
What we see. then, are selectioi^ , differences that are of the same order of magnitude 
as the test score correlation differences:, Clearly, selection differences could be 
large enough to acooiint for the sophomore "common school" pattern. This is hardly 
conclusive, but to us it at least Is suggestive. The burden of proof continues to . 
rest with those %dio favor the effectiveness hypothesis, and it seems to ua a 
copsiderable burden indeed. 

Rather than persist in the elusive quest for substantial private sector effects 
on cognitve perfbrmance. a more constn^cUve agenda for the future might well be to 
ponder why it is that private schools don't outpace pubUc institutions by the sort of 
narflin that their many advantages would seem to anticipate.. The pattern of results 
regarding puMic-CatholIc differences do Indeed strike us as prov^ative (and 
potentially Important), but not at all for the reasons given by Coleman, Hoff er and 
KUgore. 
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TABLE 1 • 

INDEPENDENT VARIABLES USED IH REGRESSION ANALYSES 



Variable 
School sector 

Region 



Variable 

Name 

. ^ 

PUBPRIV 



NEAST 
NC 
. SOUTH 



SES 



BYSES 



Race/ethnicity BLACK 

HISPANIC 



Sex 



SEi 



Codes and Sources 

Coded 1 if Catholic; 0 if public. 
(HSB Question- FLAGl 7) 

Coded 1 if Northeast; 0 otherwise. 
Coded 1 if Nonth Central; 0 otherwise. 
Coded 1 if South; 0 otherwise. 

(West is omitted category) 

(HSB Question FLAG19)' 

An equally weighted linear composite of 
standardized measures of father's education, 
mother's education, father's occupation, 
family income, and household items. 
(HSB Question FLAG25) ' 

Coded 1 if black; 0 otherwise. 
Coded 1 if Hispanic; 0 otherwise. 
(HSB Question FLAG22) 

Coded >if female;''0 if male. 
(HSB Question FLAG21 ) 



Table 2 



EstiMtes of Sector Differences In Sophomore to^ Senidr Patterns of 
Test Score Change fro« the Panel* , 





Estimated Formula 

Score Dlf^f ^r^nr*« 




As Fractions of a 
zear s orowtti 


As Fractions of the 
Test Standard Deviation 


Composite 




.66 


• 08 , 


Reading 

■ - a 


• 665 




1.13 


.06* 


Vocabulary 


.707 




.69 


.12 


Mathematics 


.311 - 


i 


.36 


* 

.06 ' 


Science 






.29 


• 03 


Writing 


^509 




.64 


.10 


Civics 


-.029 




-.05 


-.01 



a. Figures are derived from parallel regressions which have been evaluated. at the " 
public school Means. The predictors used are three dtimy variables for. region of the- 
country, a dumy variable distinguifhing blacks froa whites, a dumy variable 
distinguishing Hispanic youngsters fro* non-Hispanics. a sex code, an SES composite, and 
the sophomore year counterpart of the outcome test. All correlations involving tests have 
been corrected for random error using reliability estimates reported in Heyns and Hilton 
(4982). ' j! 



Adjusted Sector Differences in Test, Outcomes, 
with Tests Corrected ifor Attenuation 



Evaluated at 
Public Means 



Evaluated at 
Catholic Means 



COMPOSITE 



(1) 
(2) 
(3) 
(4) 



.08 

.os"* 



• 06 

• 18 

• 06 

• 09 



VOCABULARY 



(1) 
(2) 

(3) 
(4) 



. .12 

• 32 

• 12 
.25 



• 05 
^19 

• 0>, 

• 12 



READING 



(1) 
(2) 
(3) 



• 06 

• 22 

• 04 

• 13 



• 04 

• 12 

• 03 

• 05 



MATH 



(1) 
(2) 
(3) 
(4) 



• 06 

• 27 

• OS 

• 19 



• 15 
.06 
.06 



. ■ / 



SCIENCj: 



WRITING 



CIVICS 



(1) 
(2) 
(3) 
(4) 



(1) 



(3) 
(4) 



(1) 
(2) 
(3) 
(4) 



.03 
.09 
.03 

;02 



.10 



.09 
.21 

-•ai 

* ^16 
-.02 
• 08 



• 04 
-•01 

• 03 
-•08 



• 04 



• 03 
..10 



-•03 

• 04 
-.04 

• 04 



ERIC 



Note; (0"Kackground controls and input test contrpl; (2)>Background controls; 
I (3)« B^cRgK^und controls and input test control and curriculum; « 
( 4) "Eackgroupd controls and curriculuw^ 
^ The adjustmcint involves a regression standardization in which the following 

background contrpls-^&re used: NEAST^NC» SOUTH* BLACK» HISPANIC^ :SEX» BYSES^ Regressions 
O are. corrected for unreliability in test sco^^ I>redictors and outcomes • 
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Table 4 

Wlthln-Sector Background Effects on Test Performance 
, With and Without Input Test Controls ' • 



(I) 
PUBLIC 
BACKGROUND 
CONTROLS 
ONLY 



^ (II) 
CATHPLIC 
E^CKGROUND 
CONTROLS 
ONLY * 



(I-II) 



(III) y 

PUBLIC 
BACKGROUND 

% AND 
INPUT TEST 



(IV) 
CATHOLIC 
BACKGROUND 

AND 
INPUT TEST 



(III-IV) 



TEST82 

BLACK 

HISPANIC 

BYSES 



•10.287 
-11.202 
10.141 



-9.636 
-9.624 
51995 



.651 
1.578 
4.146 



.352 
-.733 
.844 



-.312 
-1.108 
1.245 



0 
0 
0 



VOCABULARY 
4#LACK 
HISPANIC 
BYSES 



.282 



^3.428 
-3.296 
2.934 

.290 



.154 



-2.680 
-2.736 
1.675 

.157 



^748 
-.560 
1.2S9 



.916 



-.187 
-.29^ 
*264 

\ 

^937 



.875 



7.049 
-.674 
?109 



.867 



.138 



153 



READING 

BLACK 

HISPANIC 

BYSES 



-2.540 
-2.764 
2.365 

.212 



-^.724 
-2.219 
1.468 

.104 



.816 
.545' 
.897 



.238 
.137 
.212 

I 

.871 



-.227 
-.518 
.265 

.829 



• Oil 



0 
0 



MATH 



BLACK 

HISPANIC 

BYSES 



-5*187 
-5.733 
5.311 



-5.776 
-5.233 
3.160 



0 

.500 
2.151 



.366 
.502 
.536 



-.097 
-.194 
1.107 



.306 



SCIENCE 
BLAPK 
HISPANIC 
I^YSES 



.253 



-3.509 
-3. 102 
L.958 



:i41 



•3.371 
-2.185 
1.400 



.138 
.917 
.558 



.921 



.004 
.197 
.067 



.862 



-1.288 
-.565 
.459 



0 
0 
0 



R- 

WRITING 

BLACK 

HISPANIC 

BYSES 



.297 



-2.823 
-2.795 
2.051 

.264 



, ^ .180 

^ -2.U5 
-2.447 
1. 106 

y .178 



.708 
.348 
.945 



.933" 



-.«226 
-.268 
.248 

.801 



.817 



-.279 
-.678 
.339 

.717 



' 0 
0 
0 



CIVICS 

BLACK 

HISPANIC 

BYSES 



-.992 
-1.389 
» 1.249 

. 206 



-1.035 
-L.602 

V699 

\ 

1 



0 
0 



.550 



47 



-.273 
-6328 
.13i^ 



-..595 
-1.006 
.318' 

.715 



ERIC^ Piguifes in which the Cathdlip^seckor c6e 

HM«aa « haye-:*een^:«et^it<^^ 



.861 

ents are larger than their public 



0 
0 
0. 



aecfior 



Table 5 



Public-Catholic Test Score Dif'ferences from 
Coleman, Hoffer and Kilgore*8 Three Analyses^ 

As Fractions of a Year's Growth** 





A. 

Cro88*Sectional Results 


Synthetic Cohort Results^ 


C. 

School-Based^ 




Sophomore^ Senior^ 


Background 
Adjusted 


Dropout 
Adjusted 


Predictor 
Sophoioore 


Results 
Senior 


Reading 


.876 .657 


0.00 


0.00 


1.04 


. 767 


Vocabulary 


1.14 1.78 


.603 


.635 


.286 


.159 


Mathematics 


1.32 1.36 


.023 


.682 


, 1.39 


3.20 




As Fractions of 


the Test Battery Standard Deviation 






A. 

Cross-Sectional Results 


B. 

Synthetic Cohort Results^ 


School-Based 




SophodM>re • Senior 


Eackground 
Adjusted 


Dropout 
Adjusted 


Predictor 
Sophomore 


Results 
Senio] 


Reading - 


.159 .lU 


.000 


.000 




.133 


Vocabulary 


.189 .284 


.096 


.102 


.047 


.025 


Mathematics 


• 144 ^ .141 


.002 


.071 


.151 • 


.333 



-a. The ^estimates in A and B are derived from parallel regressions which have been 
evaluated At the public school means. 

b. The frame of reference ot determining a year's growth was one-half the adjusted public 
school sophomore to senior change^ reported by Coleman, Hoffer and Kilgore in Table 6-7, 
P. 138. The^f igures uited are: .365 for Reading; .315 for Vocabulary; and, .44 for 
Mathematics, as reported in Table 1, above. 



c. The adjusted raw scpre di^fferences from which these figures were derived are reported 
:in Colernan, Hoffer anjd Kilgore*s^Table 6-7, P. 138. They were obtained by applying the 

Catholic means on the school-based' predictors to public equation. 

d. The adjustjed raw score differences from which these figures were derived are reported 
in Coleman, Hoffer and Kilgore's Table 6-21, P. 171. Apparently /these compat'isons are 
adjusted to the family background characteristics of public school sophomores. 

• . ■ ■ • - / 

€• Thet*adjuste4 raw score differences from which these figures were derived are reported 

in Coleman, Hoffer and Kilgore's Table 6-8, P. 142, and Table 6-II, P. 149. 

t. The est^imated changes in public school performance from which these figures were 
derived aire reported in Coleman, Hoffer and Kilgore's Table 6-21, P. 171. 

g. TJte pooled senior year standard deviations reported by Coleman, Hoffer and Kilgore in 
Table.6-3; p. 127 were used to compute these entries. 
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Table 6 

Zero-Ord«»r Correlations of Sophomore Test Performance, 
SFS and Race/Ethnicity, Separately by Sector* 



PUBLIC 



CATHOLIC 



1960 

COMPOSITE BYSES 



1980 

COMPOSITE BYSES 



BYSES 
BLACK 
111 SPAN u: 



»453 
• 24 7 
»231 



-.193 
-.165 



.254 



/ 



-.138 -.052 



-.190 



*Notct Test coi^relatjons are correcteds for attenuation* 



-.142 



49 
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